System and method for displaying additional information on 3d tour

ABSTRACT

The present inventive concept is a technique related to a system and method for displaying additional information on a 3D tour. In this case, the method for displaying additional information on a 3D tour performed by a server for providing a 3D tour service linked to a user terminal, the method includes providing a 3D tour comprising 3D information of a particular space to the user terminal, receiving coordinate information for a start point and an end point of an additional-information signpost to be created newly on the 3D tour displayed on the user terminal, creating an additional-information signpost connecting the start point and the end point, and overlappingly displaying the created additional-information signpost on the 3D tour.

CROSS-REFERENCE TO RELATED APPLICATION

This application claims priority from Korean Patent Application No.10-2019-0135429 filed on Oct. 29, 2019, and Korean Patent ApplicationNo. 10-2019-0135475 filed on Oct. 29, 2019, in the Korean IntellectualProperty Office, and all the benefits accruing therefrom under 35 U.S.C.119, the contents of which in their entirety are herein incorporated byreference.

BACKGROUND 1. Field of the Inventive Concept

The present inventive concept relates to a system and method fordisplaying additional information on a 3D tour. In particular, thepresent inventive concept relates to a system and method for providingan interface capable of expressing additional information in a 3D formon a 360-degree 3D tour configured in three-dimension (3D). In addition,the present inventive concept relates to a system and method forproviding an interface capable of tagging and displaying additionalinformation by linking 2D and 3D screens.

This work was supported by Institute of Information & communicationsTechnology Planning & Evaluation (IITP) grant funded by the Koreagovernment (MSIT) (No. 2017-0-00486, Video Enhancement and Transcoderbased on the Space Geometry of 360 VR Contents).

2. Description of the Related Art

The best way to record a 3D space is to capture a 360-degreeomnidirectional view for a particular point and save it as a panoramicimage, and combine panoramic images for a plurality of points to createa single 3D tour form.

Here, a 3D tour may consist of a combination of panoramic images (e.g.,360-degree images) that are captured at 360 degrees respectively at aplurality of points and then stored. In this case, the 3D tour mayinclude location information in which each image is captured, and eachlocation information may be mapped onto a floor plan and provided to auser.

In this case, there exists a need for users who use 3D tours to includeand express additional information such as notes, images, videos, and soon onto the 3D tours.

However, existing interfaces for displaying additional informationprovided only the function of displaying additional information such asnotes, images, or the like recorded by users in 2D on a floor plan. Inthis case, since the additional information was displayed only on thefloor plan, there was a problem that it was difficult for a user toclearly display, in the space of the 3D tour, the additional informationfor a particular location where the user intended to put a note.

Furthermore, since the location was not clearly represented, there alsowas a problem that it was difficult for other people to clearly graspthe meaning of the additional information added.

Moreover, in the case of existing interfaces for displaying additionalinformation, recorded additional information could be recognized only ata particular location, and thus, if the viewing angle for an image in a3D tour was changed, there was a problem that the set additionalinformation could not be checked.

In addition, for existing interfaces for recording additionalinformation, since a 3D photographing interface and an interface forinputting additional information were separate, there was aninconvenience that a user had to separately input additional informationonto a floor plan after photographing a 3D tour.

Further, for existing interfaces for recording additional information,since information inputted on a floor plan is not linked to a 3D tour,there was an inconvenience that a user had to separately input alocation, corresponding to the additional information inputted on thefloor plan, onto the 3D tour or check it separately.

In addition, there was a problem that it was difficult for other peopleto clearly grasp the meaning of the additional information displayed ona floor plan.

SUMMARY

It is an object of the present inventive concept to provide a system andmethod for displaying additional information on a 3D tour that displayrelevant additional information at a particular point specified by auser in a 3D form, for various types of additional information that theuser wants to record while using 3D tours.

Further, it is another object of the present inventive concept toprovide a system and method for displaying additional information on a3D tour that allow a user to check set additional information at adesired location, by specifying 360-degree images, on which theadditional information is displayed, by the user.

Furthermore, it is yet another object of the present inventive conceptto provide a system and method for displaying additional information ona 3D tour that enable the location of an additional-information signpostto be checked at a glance by displaying the locations of pieces ofadditional information added to a 3D tour together on a floor plan.

Moreover, it is still another object of the present inventive concept toprovide a system and method for displaying additional information on a3D tour capable of simultaneously performing tasks of 3D photographingfor a space and of inserting various types of additional informationinto a floor plan when photographing for 3D tour creation.

In addition, it is a further object of the present inventive concept toprovide a system and method for displaying additional information on a3D tour that allow the location of the additional information to becalculated automatically and the additional information to beautomatically displayed at a corresponding location on a second screen(e.g., a 3D tour screen) if the additional information is inserted at aparticular location on a first screen (e.g., a 2D floor plan).

The objects of the present inventive concept are not limited to thosementioned above, and other objects and advantages of the presentinventive concept that have not been mentioned can be understood by thefollowing description, and will be more clearly understood byembodiments of the present inventive concept. In addition, it will bereadily understood that the objects and advantages of the presentinventive concept can be realized by the means and combinations thereofset forth in the claims.

According to an aspect of the present inventive concept, there isprovided a method for displaying additional information on a 3D tourperformed by a server for providing a 3D tour service linked to a userterminal, the method includes providing a 3D tour comprising 3Dinformation of a particular space to the user terminal, receivingcoordinate information for a start point and an end point of anadditional-information signpost to be created newly on the 3D tourdisplayed on the user terminal, creating an additional-informationsignpost connecting the start point and the end point, and overlappinglydisplaying the created additional-information signpost on the 3D tour.

In some embodiments of the present inventive concept, wherein thereceiving coordinate information for a start point and an end pointcomprises, if a line connecting two points on the 3D tour is inputtedfrom the user terminal, setting one end of the inputted line as thestart point and setting the other end of the line as the end point.

In some embodiments of the present inventive concept, wherein thereceiving coordinate information for a start point and an end pointcomprises if only one point on the 3D tour is inputted from the userterminal, setting the inputted point as the end point, and setting apoint on a floor surface or wall surface located at the shortestdistance from the inputted point as the start point.

In some embodiments of the present inventive concept, wherein thecoordinate information for the start point and the end point consists ofthree-dimensional (3D) coordinates.

In some embodiments of the present inventive concept, wherein theadditional-information signpost is displayed in different shapes atdifferent locations in the 3D tour.

In some embodiments of the present inventive concept, further comprisingproviding an interface for selecting a photographing point on which theadditional-information signpost is displayed out of a plurality of imagephotographing points included in the 3D tour, wherein theadditional-information signpost is displayed only at a selectedphotographing point in the 3D tour.

In some embodiments of the present inventive concept, wherein the 3Dtour comprises a floor plan of the particular space, and anadditional-information icon corresponding to the location of theadditional-information signpost is displayed on the floor plan.

In some embodiments of the present inventive concept, further comprisingproviding the user terminal with an interface for setting a color, atitle, a description, or additional information of theadditional-information signpost, wherein the additional-informationsignpost is created based on the color, title, description, oradditional information inputted via the interface.

In some embodiments of the present inventive concept, wherein theadditional information is displayed on one side of theadditional-information signpost, or displayed via a separate messagewindow if a user selects the additional-information signpost.

In some embodiments of the present inventive concept, wherein theadditional information comprises one of a photo, a video, and a URLlink.

According to another aspect of the present inventive concept, there isprovided a method for displaying additional information on a 3D tourperformed by a 3D tour management server linked to a user terminal, themethod including simultaneously displaying a floor plan for a particularspace and a 3D tour photographing interface on the user terminal,receiving a photographed image of the 3D tour for the particular spacefrom the user terminal, receiving additional information via the userterminal in the process of photographing the 3D tour, combining the 3Dtour and the inputted additional information, and displaying theadditional information on the 3D tour or the floor plan.

In some embodiments of the present inventive concept, wherein thecombining the 3D tour and the inputted additional information comprisesextracting location coordinates of the additional information to beadded onto the floor plan, based on a change in the photographed imageof the 3D tour, and mapping the inputted additional information to theextracted location coordinates.

In some embodiments of the present inventive concept, wherein theextracting location coordinates of the additional information comprises,extracting a plurality of feature points from the photographed image ofthe 3D tour, and calculating a moving direction and a distance of thefeature points according to the change in the photographed image, andbased on this, extracting the location coordinates of the additionalinformation.

In some embodiments of the present inventive concept, wherein theextracted location coordinates of the additional information consist oftwo-dimensional (2D) coordinates, and the mapping the inputtedadditional information to the extracted location coordinates comprisesconverting the extracted location coordinates of the additionalinformation into three-dimensional (3D) coordinates on the 3D tour, andmapping the additional information onto the floor plan using the 2Dcoordinates, and mapping the additional information onto the 3D tourusing the 3D coordinates.

In some embodiments of the present inventive concept, wherein thereceiving additional information comprises receiving a particularlocation for inserting the additional information on the floor planduring the 3D photographing, and receiving additional information to beinserted at the particular location via an interface for insertingadditional information.

In some embodiments of the present inventive concept, wherein aphotographing process of the 3D tour is displayed on one side of ascreen of the user terminal, the floor plan is displayed on the otherside of the screen of the user terminal, and the receiving a particularlocation comprises receiving location information selected by a user onthe floor plan.

In some embodiments of the present inventive concept, wherein theinterface for inserting additional information selects the type ofinformation of one of a note, a photo, a video, and an Internet link,and receives additional information corresponding to that type ofinformation.

In some embodiments of the present inventive concept, wherein thedisplaying the additional information comprises displaying anadditional-information icon at an insertion location of the additionalinformation on the floor plan, and displaying a 3Dadditional-information signpost corresponding to theadditional-information icon on the 3D tour.

In some embodiments of the present inventive concept, wherein the 3Dadditional-information signpost comprises a start point located on afloor surface or wall surface of the 3D tour, an end point correspondingto the location of the additional-information icon, and a body partconnecting the starting point and the ending point.

According to still another aspect of the present inventive concept,there is provided a system for displaying additional information on a 3Dtour, the system including a processor, and a memory having storedthereon a program executed by the processor, the program including anoperation of simultaneously displaying a floor plan for a particularspace and a 3D tour photographing interface on a user terminal, anoperation of receiving a photographed image of the 3D tour for theparticular space from the user terminal, an operation of receivingadditional information via the user terminal in the process ofphotographing the 3D tour, an operation of combining the 3D tour and theinputted additional information, and an operation of displaying theadditional information on the 3D tour or the floor plan.

The system and method for displaying additional information on a 3D tourin accordance with the present inventive concept enable a user to set anadditional-information signpost in a 3D form at a desired location,thereby displaying the additional information at an exact locationintended by the user. This makes it possible to convey a clearexplanation and meaning of a particular point to other users who use thesame 3D tour.

In addition, the system and method for displaying additional informationon a 3D tour in accordance with the present inventive concept make itpossible to check corresponding additional information at variouslocations in a 3D tour by providing an interface for selecting aparticular 360-degree image on which a 3D additional-informationsignpost is intended to be displayed and by displaying the corresponding3D additional-information signpost only on the selected image. As aresult, the convenience for users can be improved, and the intention ofdisplaying the additional information can be clearly conveyed to aplurality of users.

Further, the system and method for displaying additional information ona 3D tour in accordance with the present inventive concept can provide auser with an intuitive interface that allows the user to grasp thelocation of inserted additional information at a glance by automaticallydisplaying the location where the additional information is displayed ona floor plan in a 3D tour.

Moreover, the system and method for displaying additional information ona 3D tour in accordance with the present inventive concept can reducethe inconvenience that a user has to perform a separate task ofinserting the additional information after a 3D tour photographing byenabling the 3D tour photographing and the insertion of the additionalinformation into a floor plan, at the same time.

In addition, the system and method for displaying additional informationon a 3D tour in accordance with the present inventive concept canimprove the convenience for users by automatically displaying theadditional information inserted onto a floor plan in the form of anadditional-information signpost at a corresponding location in a 3Dtour.

Furthermore, the system and method for displaying additional informationon a 3D tour in accordance with the present inventive concept canclearly convey the meaning of the additional information in question toother users who use the same 3D tour.

The effects of the present inventive concept are not limited to thosedescribed above, and those skilled in the art of the present inventiveconcept can readily derive various effects of the present inventiveconcept from the configurations of the present inventive concept.

BRIEF DESCRIPTION OF THE DRAWINGS

The patent or application file contains at least one drawing executed incolor. Copies of this patent or patent application publication withcolor drawing(s) will be provided by the Office upon request and paymentof the necessary fee.

FIGS. 1 and 2 are block diagrams for illustrating a schematicconfiguration of a system for displaying additional information on a 3Dtour in accordance with some embodiments of the present inventiveconcept;

FIG. 3 is a flowchart for illustrating a method of adding and displayingadditional information in a 3D tour in accordance with an embodiment ofthe present inventive concept;

FIGS. 4 and 5 are views for illustrating an interface for settingadditional information, provided by a system for displaying additionalinformation on a 3D tour in accordance with an embodiment of the presentinventive concept;

FIGS. 6A to 6C are views for illustrating an example in which additionalinformation added to a 3D tour is expressed in a system for displayingadditional information on a 3D tour in accordance with an embodiment ofthe present inventive concept;

FIG. 7 is a view for illustrating a function of displaying addedadditional information only at particular image photographing points ina system for displaying additional information on a 3D tour inaccordance with an embodiment of the present inventive concept;

FIGS. 8A and 8B are views for illustrating another example in whichadditional information added to a 3D tour is expressed in a system fordisplaying additional information on a 3D tour in accordance with anembodiment of the present inventive concept;

FIG. 9 is a diagram illustrating a floor plan on which icons for addedadditional information are displayed in a system for displayingadditional information on a 3D tour in accordance with an embodiment ofthe present inventive concept;

FIG. 10 is a flowchart for illustrating a method for displayingadditional information on a 3D tour in accordance with anotherembodiment of the present inventive concept;

FIG. 11 is a view for illustrating a method of photographing a space ina system for displaying additional information on a 3D tour inaccordance with another embodiment of the present inventive concept;

FIG. 12 is a view for illustrating an example of an interface forinserting additional information in accordance with another embodimentof the present inventive concept;

FIG. 13 is a diagram illustrating a floor plan on which icons ofadditional information inserted via the interface for insertingadditional information of FIG. 12 are displayed;

FIGS. 14A to 15 are views for illustrating expressing additionalinformation by combining a floor plan and a 3D tour in a system fordisplaying additional information on a 3D tour in accordance withanother embodiment of the present inventive concept; and

FIGS. 16 and 17 are views for illustrating a tracking method performedby a system for displaying additional information on a 3D tour inaccordance with another embodiment of the present inventive concept.

DETAILED DESCRIPTION OF THE EMBODIMENTS

The advantages and features of the present inventive concept and methodsof achieving them will be apparent when reference is made to theembodiments described in detail below in conjunction with theaccompanying drawings. However, the present inventive concept is notlimited to the embodiments disclosed below but will be implemented in avariety of different forms, the present embodiments merely make thedisclosure of the present inventive concept complete and are provided tofully convey the scope of the inventive concept to those having ordinaryskill in the art to which the present inventive concept pertains, andthe present inventive concept is defined only by the scope of theclaims. Like reference numerals refer to like components throughout thespecification.

The terms used herein are for describing embodiments and are notintended to limit the present inventive concept. Herein, singular formsalso include plural forms unless specifically stated in the context. Asused herein, “comprises” and/or “comprising” means that the components,steps, operations, and/or elements mentioned do not preclude thepresence or addition of one or more other components, steps, operationsand/or elements.

Unless otherwise defined, all terms (including technical and scientificterms) used herein will be used in the sense that can be commonlyunderstood by those of ordinary skill in the art to which the presentinventive concept pertains. Further, terms defined in commonly useddictionaries are not to be interpreted ideally or excessively unlessexplicitly defined specifically.

In the present inventive concept, a ‘3D tour’ may consist of acombination of a plurality of images (e.g., panoramic images) that arecaptured at 360 degrees respectively at a plurality of points and thenstored. In this case, the ‘3D tour’ may include location information inwhich each image is captured, and each location information may bemapped onto a floor plan and provided to users.

Hereinafter, a system and method for displaying additional informationon a 3D tour in accordance with an embodiment of the present inventiveconcept will be described in detail with reference to the drawings.

FIGS. 1 and 2 are block diagrams for illustrating a schematicconfiguration of a system for displaying additional information on a 3Dtour in accordance with some embodiments of the present inventiveconcept.

Referring to FIG. 1, a system for displaying additional information on a3D tour in accordance with an embodiment of the present inventiveconcept comprises a server 100 for displaying additional information ona 3D tour (hereinafter, referred to as a server) and a user terminal200. The server 100 and the user terminal 200 may be implemented as aserver-client system.

In this case, the server 100 may select an image corresponding to aparticular point selected by a user out of a plurality of imagephotographing points included in a 3D tour and provide it to the userterminal 200. The server 100 may transmit and receive data to and fromthe user terminal 200 via a wired or wireless network.

Although only one user terminal 200 is illustrated in FIG. 1, thepresent inventive concept is not limited thereto, and the server 100 mayoperate in conjunction with a plurality of user terminals 200.

The server 100 may store and manage a plurality of different 3D tours.In this case, the server 100 may receive a coordinate value for creatingan additional-information signpost from the user terminal 200, and maydisplay additional information using the additional-information signposton the 3D tour, using the coordinate value received. A detaileddescription of a method for displaying additional information on a 3Dtour will be described later.

Also, the server 100 may insert the additional information at particularpoints selected by the user, and display icons for the additionalinformation on a floor plan and a 3D tour in the user terminal 200. Theserver 100 may transmit and receive data to and from the user terminal200 via a wired or wireless network.

The server 100 may store and manage captured 60-degree images, a floorplan for a 3D tour, a 3D additional-information signpost, and anadditional-information display icon, via the user terminal 200.

Thereafter, the server 100 may provide the 360-degree images, the 3Dtour, the 3D tour floor plan, the 3D additional-information signpost,and the additional-information display icon to the user terminal 200.

The server 100 may display the 3D tour and the additional informationinserted into the floor plan of the 3D tour simultaneously on the screenof the user terminal 200. At this time, a process of photographing a 3Dtour may be displayed on one side of the screen of the user terminal200, and the floor plan of the 3D tour may be displayed on the otherside.

In addition, the server 100 may input and display the additionalinformation on the floor plan of the 3D tour, and at the same time, mayalso input and display the additional information of the samedescription on the 3D tour.

Specifically, the server 100 may automatically create and displayadditional-information signposts at corresponding locations in the 3Dtour, based on the location coordinates of the additional informationinputted through the floor plan during the 3D tour photographing.

In other words, the server 100 may display additional-information iconsat the locations where the additional information was inputted on thefloor plan, and display 3D additional-information signposts at thecorresponding locations in the 3D tour. A detailed description of amethod for inputting and displaying the additional information on thefloor plan, and inserting and displaying that additional information inthe 3D tour will be described in detail below. Hereinafter, theconfiguration of the server 100 will be described in detail.

On the other hand, referring to FIG. 2, the server 100 comprises amemory 120 having stored thereon a program for implementing thetechnical idea of the present inventive concept, and a processor 110 forexecuting the program stored in the memory 120.

In this case, the data related to the 3D tour and the additionalinformation on the 3D tour may be stored in the memory 120. For example,the 3D tour may comprise 360-degree photographed images, coordinates ofthe photographing locations for the photographed images, data on thefloor plan to which corresponding coordinates are mapped, data on theadditional-information signposts added into the 3D tour, and data on thesetting of the additional information.

Here, the data on the additional-information signpost may include thedescription of the additional information, the color of theadditional-information signposts, the coordinates of theadditional-information signposts, the location in the floor plan towhich the corresponding coordinates are mapped, and so on. In addition,the data on the setting of the additional information may include dataon the description of the additional information, the icons forrepresenting the additional information, the coordinates of theadditional-information signposts, and the floor plan to which thecorresponding coordinates are mapped.

An algorithm for the method for displaying additional information on a3D tour may be stored in the memory 120. Here, the method for displayingadditional information on a 3D tour refers to a method of providing aninterface for setting additional information in a 3D form on the 3D tourconfigured in 3D. In this case, the processor 110 may be the executionsubject for the corresponding algorithm.

Specifically, the server 100 may provide the interface for setting 3Dadditional information through which the user can create theadditional-information signposts in a 3D form on the 3D tour.

At this time, the server 100 may receive coordinate values for the startpoint and end point of the additional-information signpost and createthe additional-information signpost, and map the additional informationinputted by the user to the additional-information signpost created.

Further, the server 100 may provide an interface for displaying theinputted additional information only at a particular location byallowing the user to specify an image photographing point where theadditional-information signpost is to be displayed.

Moreover, the server 100 may display the location of the additionalinformation set in the 3D tour together on the floor plan. A detaileddescription thereof will be set forth below with reference to thedrawings.

Additionally, the processor 110 may be referred to as different namessuch as a CPU or a mobile processor, depending on the implementations ofthe server 100.

The memory 120 may be implemented in any form of storage device that canstore a program and can be accessed by the processor to run the program.Depending on hardware implementations, the memory 120 may be implementedin a plurality of storage devices instead of one storage device.Further, the memory 120 may comprise not only a main storage device butalso a temporary storage device. In addition, the memory 120 may also beimplemented in a volatile memory or a nonvolatile memory, and may bedefined in the sense of including all forms of information storage meansimplemented so that a program can be stored and run by a processor.

Moreover, the server 100 may be implemented in various ways such as aweb server, a computer, a mobile phone, a tablet, a TV, and a set-topbox, depending on the embodiments, and may be defined in the sense ofincluding any forms of data processing device capable of performing thefunctions defined herein.

The server 100 may further comprise various peripheral devices (e.g.,peripheral device-1 131 to peripheral device-N 139) depending onembodiments. For example, the server 100 may further comprise peripheraldevices such as a 360-degree camera, a keyboard, a monitor, a graphicscard, and a communication device.

Hereinafter, a method for displaying additional information on a 3D tourperformed by the server will be described in detail.

FIG. 3 is a flowchart for illustrating a method of adding and displayingadditional information in a 3D tour in accordance with an embodiment ofthe present inventive concept.

Referring to FIG. 3, in the method for displaying additional informationon a 3D tour for displaying the additional information in 3D in the 3Dtour in accordance with an embodiment of the present inventive concept,first, a server 100 provides a 3D tour for a particular space to a userterminal 200 (S110).

Next, the server 100 receives coordinate information for the start pointand end point of an additional-information signpost (S120). In thiscase, the user may specify a particular point on the 3D tour displayedon the user terminal 200 as the start point or the end point.

For example, the server 100 may provide a menu capable of adding theadditional information through a mouse click or a touch input in the 3Dtour. The user may input the start point and end point of theadditional-information signpost by selecting the menu for adding theadditional information. In this case, the menu for adding the additionalinformation may be provided through various modifications, such as beingreplaced with a button for adding additional information in the toollist window.

In addition, the start point and end point of the additional-informationsignpost may be derived from a line connecting two points on the 3D tourreceived from the user terminal 200 by the server 100. In this case, oneend of the line inputted from the user may be set as the start point,and the other end of the line may be set as the end point.

On the other hand, if only one point is inputted from the user terminal200, the server 100 may set the inputted point as the end point, and seta point on a floor or wall surface located at the shortest distance fromthe inputted point as the start point.

In this case, the coordinate information of the start point and endpoint of the additional-information signpost may be stored in the formof three-dimensional spatial coordinates.

Further, the end point of the additional-information signpost may bedisplayed in various shapes in the 3D tour. For example, the end pointof the additional-information signpost may comprise diverse variationssuch as a circle, a triangle, a square, and the like.

Thereafter, the user sets the additional information to be inserted, viathe interface for setting additional information (S130). At this time,the user may set the color, title, description, and the like of theadditional-information signpost via the interface for setting additionalinformation, and insert various types of additional information (e.g.,photos, videos, URLs, etc.). In this case, a pop-up window for settingadditional information may appear automatically after the start pointand end point of the additional-information signpost have beenspecified, or may appear when the additional-information signpostcreated is clicked. However, this is only one example, and the presentinventive concept is not limited thereto.

Next, the server 100 creates an additional-information signpost usingthe coordinate values of the start point and the end point, and displaysthe created additional-information signpost on the 3D tour (S140). Atthis time, the start point and end point inputted may be connected toeach other, and may be represented as an additional-information signpostin a 3D form on the 3D tour. Also, the additional information set on thecorresponding additional-information signpost may be separatelydisplayed near that additional-information signpost.

Thereafter, the server 100 displays an additional-information icon on afloor plan corresponding to the location to which theadditional-information signpost has been added on the 3D tour (S150). Inthis case, the server 100 may display the additional-information iconfor the additional-information signpost added into the floor plan byconverting the 3D coordinates of the added additional-informationsignpost into 2D coordinates. The additional-information icon may bedisplayed in different icons (e.g., a photo icon or a video icon)depending on the type of additional information.

Hereinafter, the interface for setting additional information providedby the serverwill be described in detail.

FIGS. 4 and 5 are views for illustrating an interface for settingadditional information, provided by a system for displaying additionalinformation on a 3D tour in accordance with an embodiment of the presentinventive concept.

Referring to FIG. 4, a user may set a start point SP and an end point EPvia an interface for setting additional information.

For example, once the user selects a particular location in the 3D tour,the start point SP of an additional-information signpost may be set inthe 3D tour.

Thereafter, when the user selects another particular location, the endpoint EP of the additional-information signpost is set in the 3D tour.At this time, the start point SP and the ending point EP of theadditional-information signpost M1 may be stored in the server 100 inthe form of 3D coordinates.

Next, when the start point SP and the end point EP of theadditional-information signpost are set, a body part BD connecting thetwo points is created, and as a result, the additional-informationsignpost M1 may be displayed on the 3D tour in a 3D form.

In addition, a first mark MS is displayed on a floor surfacecorresponding to the start point SP of the additional-informationsignpost M1 created, and a second mark ME may be displayed on the floorsurface corresponding to the end point EP. The first mark MS and thesecond mark ME are additional representations for clarifying thelocation of the additional-information signpost on the 3D tour, and maybe omitted according to predetermined set values.

However, the method of inputting the start point SP and the end point EPdescribed above is just one example, and the selection of the startpoint SP and the end point EP may be set through various modificationssuch as a mouse click or drag, input through continuous touch, input viathe menu for adding additional information, and so on.

Referring to FIG. 5, after the user sets the start point SP and the endpoint EP, a pop-up SB for setting additional information may beexecuted. However, this is just one example of a method of displayingthe pop-up SB for setting additional information setting, and the pop-upSB for setting additional information may be modified and implemented invarious ways, such as displaying through the right-clicking of a mouse,or appearing when clicking on the additional-information signpost, orthe like.

The pop-up SB for setting additional information may comprise a signpostcolor box CB, a text input box TB, and an additional-information add boxIB.

Specifically, the signpost color box CB may specify the color of the endpoint EP of the additional-information signpost. When the user clicksthe color to specify, the color of the end point EP of theadditional-information signpost may be changed to the color specified bythe user. In this case, the signpost color box CB may comprise a numberof colors (e.g., red, yellow, green, sky blue, blue, purple, etc.), andthe colors included in the signpost color box CB are modified andarranged in various ways.

The text input box TB may receive the title and description of theadditional-information signpost. When the user inputs a title and adescription, the title and description inputted may be inserted into theadditional-information signpost and displayed in a separate messagewindow on one side of the additional-information signpost.

The additional-information add box IB may specify various types ofadditional information to be added. For example, the user may furtherspecify photos, videos, URL links, etc. via the additional-informationadd box IB.

In other words, the user may add specific additional information to theadditional-information signpost and display it, via the pop-up SB forsetting additional information.

As a result, the system for displaying additional information on a 3Dtour in accordance with the present inventive concept can allow the userto set the additional-information signpost at a desired location, andmay display various additional information intended by the user.

FIGS. 6A to 6C are views for illustrating an example in which additionalinformation added to a 3D tour is expressed in a system for displayingadditional information on a 3D tour in accordance with an embodiment ofthe present inventive concept.

Referring to FIG. 6A to 6C, an additional-information signpost set by auser may be checked at various locations in a 3D tour.

For example, FIG. 6A shows the additional-information signpost viewedfrom a first point, FIG. 6B shows the additional-information signpostviewed from a second point, and FIG. 6C shows the additional-informationsignpost viewed from a third point. Here, the first to third pointsrepresent different image photographing points.

Referring to FIGS. 6A to 6C, the user can check the location anddescription of the additional-information signpost previously inputtedat several locations in the 3D tour, and the shape of theadditional-information signpost may be displayed differently dependingon the angle.

That is, the additional-information signpost may be set in 3Dcoordinates in a 360-degree image specified by the user and displayed ina 3D form. Accordingly, the additional-information signpost may bedisplayed, with its size and angle changed according to the location andfield of view of the user.

Hereinafter, a method of setting an image for allowing anadditional-information signpost of a server to be checked will bedescribed in detail.

FIG. 7 is a view for illustrating a function of displaying addedadditional information only at particular image photographing points ina system for displaying additional information on a 3D tour inaccordance with an embodiment of the present inventive concept.

Referring to FIG. 7, a user may input various pieces of additionalinformation via the interface for setting additional informationdescribed with reference to FIG. 5. In addition, the user may select a360-degree image in which an inputted additional-information signpost isto be displayed out of a plurality of image photographing pointsincluded in a 3D tour by the interface for setting additionalinformation.

Specifically, if the user selects an image selection button SV providedin the interface for setting additional information, a pop-up window PBin which a plurality of 360-degree images included in the 3D tour arearranged is opened.

The plurality of 360-degree images included in the 3D tour may bedisplayed on a graphic box GB provided in the pop-up window PB. The usermay select a particular 360-degree image on which a selectedadditional-information signpost is to be displayed, out of the pluralityof 360-degree images shown in the graphic box GB. As a result, the usercan set the additional-information signpost to be displayed only at aparticular image photographing point. Thereafter, theadditional-information signpost in question can represent variousintentions of the user by being displayed only at the selected imagephotographing points.

As a result, the system for displaying additional information on a 3Dtour in accordance with the present inventive concept makes it possibleto check additional information at various locations in a 3D tour,thereby improving the convenience for users, by selecting a particular360-degree image on which a 3D additional-information signpost isintended to be displayed and by displaying the corresponding 3Dadditional-information signpost only on a particular image. In addition,the present inventive concept can clearly convey the user's intention todisplay the additional information

FIGS. 8A and 8B are views for illustrating another example in whichadditional information added to a 3D tour is expressed in a system fordisplaying additional information on a 3D tour in accordance with anembodiment of the present inventive concept.

Referring to FIGS. 8A and 8B, if a user inputs only one point on the 3Dtour, the system for displaying additional information on a 3D tour mayset the inputted point as an end point, and set a point on a floor orwall surface located at the shortest distance from the inputted point asa start point, thereby creating an additional-information signpost.

For example, referring to FIG. 8A, the additional-information signpostcreated by the input of one point may be set in a direction extendingupward from the floor surface. In other words, theadditional-information signpost may be formed to extend vertically fromthe floor surface. At this time, the floor surface may be set as thestart point of the additional-information signpost by default or may belocated closer to the inputted point than surrounding wall surfaces.

Next, the user may enter the interface for setting additionalinformation and input specific additional information, by selecting theadditional-information signpost created.

After completing the input of the additional information, if anotheruser clicks that additional-information signpost M2, anadditional-information window IM2 (e.g., a photo) set by the one whoinputted the additional information may be displayed on one side of theadditional-information signpost.

As another example, referring to FIG. 8B, an additional-informationsignpost in a 3D form may be set in a direction extending in aperpendicular direction from a wall surface. That is, theadditional-information signpost may be formed to extend horizontallyfrom the wall surface. At this time, the wall surface may be set as thestart point of the additional-information signpost by default or may belocated closer to the inputted point than the surrounding floor surface.

Similarly, the user may enter the interface for setting additionalinformation and input specific additional information, by selecting theadditional-information signpost created.

Further, after completing the input of the additional information, ifanother user clicks that additional-information signpost M3, anadditional-information window IM3 (e.g., a note) set by the one whoinputted the additional information may be displayed on one side of theadditional-information signpost.

In addition, FIGS. 8A and 8B may fall within preset basic shapes of theadditional-information signpost. If the user inputs additionalinformation onto a floor plan, the additional-information signpost maybe represented by FIG. 8A or FIG. 8B depending on the proximity to thefloor or wall surface.

Hereinafter, a method of displaying additional information on a floorplan in a system for displaying additional information on a 3D tour willbe described.

FIG. 9 is a diagram illustrating a floor plan on which icons for addedadditional information are displayed in a system for displayingadditional information on a 3D tour in accordance with an embodiment ofthe present inventive concept.

Referring to FIG. 9, icons for additional-information signposts set by auser may be displayed on a floor plan FP included in a 3D tour.

If the user sets the additional-information signposts in the 3D tour, aserver 100 may convert the 3D coordinates into 2D coordinates.

Next, the server 100 may display icons (e.g., photo icons, video icons,text icons) according to the type of additional information at thepoints (e.g., MC1, MC2, MC3) on the floor plan FP corresponding to thelocations where the additional-information signposts are set in the 3Dtour. The user can check the previously inputted additional informationon the floor plan FP by clicking corresponding icons.

Further, if the user sets the additional information in the floor planFP, additional-information signposts may be created on the 3D tour so asto correspond to the locations where the additional information was setin the floor plan FP.

The additional information added in the floor plan FP may be formed as acorresponding additional-information signpost in the 3D tour. In thiscase, the start point SP and the end point EP of theadditional-information signpost may be automatically set. Theadditional-information signpost may be created using a particular planarsurface (e.g., a wall, a floor, etc.) at a distance closest to thelocation set in the floor plan FP as a start point SP. In addition, theend point EP of the additional-information signpost may be perpendicularto the particular planar surface and may be set to a predeterminedheight so as to have the shortest distance from the start point SP.

In this case, the additional-information signposts created may be formedin the form of FIG. 8A or FIG. 8B depending on the proximity to thefloor or wall surface, as described above with reference to FIGS. 8A and8B.

In summary, the system for displaying additional information on a 3Dtour in accordance with the present inventive concept can improve theconvenience for users by automatically creating anadditional-information signpost, which corresponds to the location wherethe additional information is displayed on the floor plan in the 3Dtour, in the 3D tour.

FIG. 10 is a flowchart for illustrating a method for displayingadditional information on a 3D tour in accordance with anotherembodiment of the present inventive concept.

Referring to FIG. 10, in the method for displaying additionalinformation on a 3D tour in accordance with an embodiment of the presentinventive concept, a server 100 first creates a project (S210). Withinthe created project, a user may perform a task of photographing a 3Dtour and a task of inserting additional information onto a floor plan.

In this case, the task of photographing a 3D tour and the task ofinserting additional information onto a floor plan may be performedsequentially by one user within the same project, or may be performedsimultaneously by two or more users.

For example, the task of photographing a 3D tour may be performed by afirst user, and the task of inserting additional information may beperformed by a second user different from the first user. Thereafter,the task of photographing a 3D tour and the task of inserting additionalinformation performed by different users may be combined within the sameproject after the completion of the tasks.

Next, the server 100 photographs a 3D tour (S220). At this time, a 3Dtour photographing screen for a particular space and a floor plan of theparticular space may be displayed on a split-screen at the same time. Asthe 3D tour photographing screen and the floor plan screen are displayedon the split-screen, the user may insert various types of additionalinformation onto the floor plan at the same time as the photographing ofthe 3D tour.

In addition, the server 100 provides the user terminal 200 with aninterface having a button for adding additional information into thephotographing screen or floor plan. If the user touches this button, theuser terminal 200 may be provided with an interface for insertingadditional information. In other words, the user may enter the stage ofinserting additional information through a button click or a touch inputfor inserting the additional information.

Next, when the user specifies a location on the floor plan, the server100 inserts additional information at the selected location (S230). Atthis time, the user may specify the location for inserting theadditional information through a click or touch operation on the floorplan.

Thereafter, when the location for inserting the additional informationis specified, the server 100 displays the interface for insertingadditional information on the screen. The user may input various typesof additional information (e.g., notes, photos, etc.) via the interfacefor inserting additional information.

Next, the server 100 combines the inputted additional information withthe 3D tour and floor plan (S240). At this time, the server 100 mayextract the two-dimensional (2D) location coordinates of the additionalinformation inserted in the floor plan through tracking. Thereafter, byconverting the extracted 2D coordinates into 3D coordinates, thelocation of an additional-information signpost to be displayed in the 3Dtour may be automatically set.

Next, the server 100 displays the 3D tour and the additional informationinputted on the floor plan together (S250). At this time, the server 100may display the additional information inserted in the 3D tour, in the3D tour as an additional-information signpost in a 3D form.

Hereinafter, a method of photographing and tagging additionalinformation of an interface for tagging additional information in theserver will be described in detail.

FIG. 11 is a view for illustrating a method of photographing a space ina system for displaying additional information on a 3D tour inaccordance with another embodiment of the present inventive concept.

Referring to FIG. 11, the server 100 may perform a task of photographinga 3D tour of a space and a task of inserting additional information ontoa floor plan, together within the same project.

The server 100 may provide a floor plan GP on a first screen D1 and aprocess of photographing a 3D tour of a space on a second screen D2, viaa split-screen.

At this time, the user can check his/her current location via a locationsetting point AP on the floor plan GP in the first screen D1.

Further, the user may photograph a space via the second screen D2. Theuser can start photographing for creating a 3D tour by selecting arecord button B1 provided at the bottom of a 3D tour photographingscreen TP of the second screen D2.

Specifically, if the user selects the record button B1, a 360-degreecamera module (not shown) connected to the server 100 may perform aphotographing operation at 360-degree in that location to create a 3Dtour. At this time, the 360-degree camera module (not shown) mayconsecutively create 360-degree images at a constant spatial distance ortime interval. Thereafter, the server 100 may create a 3D tour bymapping a plurality of captured 360-degree images to a movement path.However, this is just one example, and a method of creating a 3D tour bya 360-degree camera module (not shown) during the 3D photographing maybe modified and implemented in various ways.

The 360-degree images created by the 360-degree camera module (notshown) may be temporarily stored in the 360-degree camera module (notshown), and may be transmitted to the server 100 when the user endsphotographing. For example, the user may end photographing by selectingthe record button B1 once again in the photographing state. If thephotographing is ended, the 360-degree images stored in the 360-degreecamera module (not shown) may be transmitted to the server 100.

In addition, the server 100 may extract a movement path of the userthrough a tracking technique. As can be seen by observing thephotographing process of the 3D tour in the second screen D2, aplurality of feature points PM may be displayed in the 3D tourphotographing screen

TP.

After extracting the plurality of feature points PM, the server 100 maycalculate the moving direction and distance of the feature points PMaccording to changes in the images captured by the user. Next, theserver 100 may calculate a movement path of the user terminal 200 usingthe extracted information. The movement path calculated may be displayedon the floor plan GP in the first screen D1.

For example, the server 100 may set the location of a 3D tour capturedby the user for the second time as a second photographing point P2, thelocation of a 3D tour captured for the third time as a thirdphotographic point P3, and the location of a 3D tour captured for thefourth time as a fourth photographic point P4, via the feature pointsPM.

Next, the server 100 may display the second photographing point P2, thethird photographing point P3, and the fourth photographing point P4 onthe floor plan GP, and represent the movement path of the user terminal200 by a line. At this time, the server 100 may extract thephotographing ranges of the first photographing point, the secondphotographing point, the third photographing point, and the fourthphotographing point, and display them on the floor plan GP.

Additionally, a 3D tour photographing distance TD may be displayed onthe 3D tour photographing screen TP in the second screen D2. Here, the3D tour photographing distance TD may represent the movement distance ofthe user terminal 200 extracted via the feature points PM.

The user may switch the screen to the interface for inserting additionalinformation by selecting a particular point in the floor plan in thefirst screen D1 when additional information to be inserted occurs whilephotographing 3D tours. Details of the interface for insertingadditional information will be described in detail with reference toFIGS. 12 and 13. Further, details of a tracking system will be describedin detail with reference to FIGS. 16 and 17.

Hereinafter, a method of inserting additional information via theinterface for inserting additional information provided by the serverwill be described in detail.

FIG. 12 is a view for illustrating an example of an interface forinserting additional information in accordance with another embodimentof the present inventive concept.

Referring to FIG. 12, a user may select a particular point TP on a floorplan displayed on the screen. Here, the particular point TP represents alocation to which additional information is to be added.

Next, the server 100 displays an interface IP for inserting additionalinformation on the screen of a user terminal 200.

Thereafter, the user may specify the type of additional information(e.g., photos, videos, texts, etc.) via the interface IP for insertingadditional information.

For example, the interface IP for inserting additional information maycomprise a video record button RB, an image capture button CB, and amedia upload button UB.

If the user selects the video record button RB, the interface IP forinserting additional information may be switched to a video record mode,and videos captured through this may be inserted into the floor plan asadditional information.

Also, the user may select the image capture button CB to capture animage, and may insert the captured image into the floor plan asadditional information. Further, the user may select the media uploadbutton UB, and may insert various types of additional information storedin and inputted to, a device including the user terminal 200, anInternet server (not shown), and the like, into the floor plan.Moreover, the user may insert a relevant note as additional informationonto the floor plan by inputting texts into a text input box TB includedin the interface IP for inserting additional information.

Next, the user may select an insert button SB to complete the insertionof the additional information. The additional information inserted maybe displayed on the floor plan in the form of an icon TI. Here, theshape of the icon TI may be displayed differently according to the typeof additional information.

The interface IP for inserting additional information illustrated in thedrawings is only one example, and an interface for inputting additionalinformation may be modified and implemented in various ways.

As a result, the server of the present inventive concept enables the 3Dtour photographing and the insertion of additional information into thefloor plan at the same time. Accordingly, the present inventive conceptcan resolve the inconvenience of a user having to separately inputrelated additional information after a 3D tour photographing.

FIG. 13 is a diagram illustrating a floor plan on which icons ofadditional information inserted via the interface for insertingadditional information of FIG. 12 are displayed.

Referring to FIG. 13, the server 100 may display icons of additionalinformation inserted by a user on a floor plan. The user may store a lotof additional information in the floor plan by specifying desiredlocations in the floor plan and inserting various types of additionalinformation (e.g., photos, videos, notes, etc.). Icons indicating thelocations of the additional information inserted may be displayed on thefloor plan.

At this time, the shapes of the icons displayed on the floor plan may bein various forms depending on the types of information. For example, ifthe user captures an image or inserts a stored image via the interfaceIP for inserting additional information, a photo icon T1 may bedisplayed on the floor plan. Further, if the user inserts additionalinformation in the form of a video, a video icon T2 may be displayed onthe floor plan, and in the case of inserting additional information inthe form of a text, a text icon T3 may be displayed.

However, the present inventive concept is not limited thereto,additional-information icons may be displayed in various shapes andimages, and the present inventive concept may comprise variousmodifications, such as directly specifying or creating the shapes oficons by a user, and the like.

The method for displaying additional information on a 3D tour inaccordance with the present inventive concept can allow a user to grasplocations of inserted additional information at a glance by displayingthe locations of the inserted additional information on a floor plan ina 3D tour as icons.

FIGS. 14A to 15 are views for illustrating expressing additionalinformation by combining a floor plan and a 3D tour in a system fordisplaying additional information on a 3D tour in accordance withanother embodiment of the present inventive concept.

The server 100 may combine additional information with a 3D tour,thereby expressing the additional information inserted into a floor plantogether in the 3D tour. The user may check the contents of theadditional information set by the user on the floor plan in the 3D tour.

Referring to FIGS. 14A to 14C, the server 100 may express the contentsof various types of additional information in the floor plan. Further,the server 100 may display locations of the additional informationinserted by the user on the floor plan of the 3D tour.

For example, referring to FIG. 14A, a plurality ofadditional-information icons, such as a first additional-informationicon IP11 and a second additional-information icon IP12, may bedisplayed on a first floor-plan GP1 of a first tour T1 at the locationswhere each additional information was inserted. If the user selects thefirst additional-information icon IP11 on the first floor-plan GP1, anadditional-information display window GI1 including anadditional-information image may be displayed.

Referring to FIG. 14B, a plurality of additional-information icons, suchas a third additional-information icon IP21 and a fourthadditional-information icon IP22, may be displayed on a secondfloor-plan GP2 of a second tour T2 at the locations where the user hasinserted the additional information. If the user selects the thirdadditional-information icon IP21 on the second floor-plan GP2, anadditional-information display window GI2 including a video inserted asadditional information may be displayed.

Referring to FIG. 14C, several additional-information icons, including afifth additional-information icon IP31 and a sixthadditional-information icon IP32, may be displayed on a third floor-planGP3 of a third tour T3. If the user selects the fifthadditional-information icon IP31 on the third floor-plan GP3, anadditional-information display window GI3 including the text inserted bythe user may be displayed.

Referring to FIG. 15, the server 100 may display the additionalinformation inserted into a floor plan in the form of anadditional-information signpost within a 3D tour.

In this case, the server 100 may extract the location of the additionalinformation inserted into the floor plan via tracking, and then createand insert an additional-information signpost at a locationcorresponding thereto.

Specifically, the server 100 may extract a plurality of feature pointsfrom an image captured during a 3D tour photographing process.Thereafter, the server 100 may calculate the moving direction anddistance of the feature points according to changes in the photographedimage through the feature points, and based on this, may extract thelocation coordinate of the additional information. At this time, thelocation coordinate of the extracted additional information may consistof 2D coordinates.

Next, the server 100 may convert the 2D coordinates of the extractedadditional information into 3D coordinates on the 3D tour.

Thereafter, the server 100 may map the additional information inputtedon the 3D tour by using the converted 3D coordinates.

Next, the server 100 may display a 3D additional-information signpost atthe mapped location in the 3D tour.

In this case, the start point of the 3D additional-information signpostmay be located on an adjacent planar surface (e.g., a floor surface or awall surface). Further, the end point of the additional-informationsignpost may be set at a predetermined height from the start point. The3D additional-information signpost may be displayed in the 3D tour inthe form of a straight line connecting the start point and the endpoint. However, the present inventive concept is not limited thereto,and the shape of the additional-information signpost may comprisevarious modifications such as curves and circles.

For example, a plurality of additional-information icons, including afirst additional-information icon IP1, a second additional-informationicon IP2, a third additional-information icon IP3, and a fourthadditional-information icon IP4, may be displayed on a floor plan GP1 ina 3D tour screen TD.

Thereafter, the server 100 may extract the location coordinates of theadditional information in the floor plan through the extraction offeature points, and may convert the extracted 2D coordinates into 3Dcoordinates, to thereby select locations for inserting additionalinformation in the 3D tour.

Next, the server 100 may create and display additional-informationsignposts corresponding to the additional information inserted in the 3Dtour.

At this time, the additional-information signposts on the 3D tour screenTD may correspond to the locations of the additional-information iconson the floor plan, respectively.

For example, in the case of the first additional-information signpostIS1, a desk surface, which is a planar surface closest to a selectedlocation, may be set as a start point. In addition, the pointcorresponding to the first additional-information icon IP1 may be set asan end point, and the additional-information signpost may be displayedby connecting the start point and the end point.

Moreover, for the second additional-information signpost IS2, the topsurface of a partition wall, which is a planar surface closest to thelocation where the second additional-information signpost IS2 isselected, may be displayed as a start point. Further, the secondadditional-information signpost IS2 may be set by setting the pointcorresponding to the location coordinate of the secondadditional-information icon IS2 as an end point and by connecting thestart point and the end point.

In addition, for the third additional-information signpost IS3, a sideface of a box on the bookshelf, which is a planar surface closest to thelocation of the third additional-information icon IS3 on the floor planGP1, may be set as a start point. Thereafter, the thirdadditional-information signpost IS3 may be displayed by setting thepoint corresponding to the location coordinate of the thirdadditional-information icon IS3 as an end point and by connecting thestart point and the end point.

Further, for the fourth additional-information signpost IS4, a floorsurface that is a planar surface closest to a selected location may bedisplayed as a start point. Next, the fourth additional-informationsignpost IS4 may be displayed by displaying the point corresponding tothe location coordinate of the fourth additional-information icon IP4 asan end point and by connecting the start point and the end point.

Hereinafter, a tracking method for extracting the location coordinatesof additional information performed by the server will be described indetail.

FIGS. 16 and 17 are views for illustrating a tracking method performedby a system for displaying additional information on a 3D tour inaccordance with another embodiment of the present inventive concept.

Referring to FIG. 9, the server 100 may extract the location coordinatesof additional information in a floor plan by using a tracking function.Here, the tracking function is a function of extracting the movement ofa user terminal 200 when a user records a video.

If the tracking function is performed, feature points PM may beextracted from a video being recorded while the video is being recorded.

Thereafter, the server 100 may calculate the moving direction anddistance of the feature points PM according to changes in thephotographed image through the extracted feature points PM. As a result,the server 100 may calculate the location change and direction change ofthe additional information. Furthermore, the server 100 may calculate amovement distance TD and display it in a 3D tour photographing screen.

Next, the server 100 may calculate current location coordinates byreferring to the information of the extracted location change.

Thereafter, the server 100 may use the calculated location coordinatesto display the additional information inserted onto the floor plan, at acorresponding location in the 3D tour in the form of a 3Dadditional-information signpost.

Referring to FIG. 10, the server 100 may split the screen of the userterminal 200, and display a floor plan GP on one side of thesplit-screen and a 3D photographing screen TP on the other side of thesplit-screen.

Specifically, the floor plan GP may be provided in a first area D1 ofthe user terminal 200, and the 3D photographing screen TP capable ofphotographing a 3D tour of a particular space may be provided in asecond area D2. In this case, the floor plan GP may correspond to afloor plan for a particular space in which the 3D tour is photographed.

If the user photographs through the second area D2, feature points PMmay be extracted from an image being captured. The server 100 mayextract the current location coordinates of the user terminal 200 byusing the extracted feature points PM.

Next, once the current location coordinates of the user terminal 200 areextracted, the server 100 may display the location AP of the userterminal 200, which is currently photographing, on the floor plan GP ofthe first screen Dl. Further, a first photographing point P1 and asecond photographing point P2 may be displayed on the floor plan GP byusing the location coordinates at the time of photographing, and themoving direction may be indicated by connecting a plurality ofphotographing points. Also, a movement path MP along which the userterminal 200 has moved may be displayed on the floor plan GP.

As a result, the system for displaying additional information on a 3Dtour in accordance with the present inventive concept can allow theadditional information inserted by the user to be displayed in both thefloor plan and the 3D tour by automatically displaying the additionalinformation inserted onto the floor plan at a corresponding location inthe 3D tour in the form of an additional-information signpost, therebyimproving the convenience for the user.

As described above, although the present inventive concept has beendescribed with limited embodiments and drawings, the present inventiveconcept is not limited to the embodiments above, and can be modified andchanged in various ways from such a description by those of ordinaryskill in the art to which the present inventive concept pertains.Therefore, the spirit of the present inventive concept should be graspedonly by the claims set forth below, and all equal or equivalentvariations thereof are intended to fall within the scope of the spiritof the inventive concept.

What is claimed is:
 1. A method for displaying additional information ona 3D tour performed by a server for providing a 3D tour service linkedto a user terminal, the method comprising: providing a 3D tourcomprising 3D information of a particular space to the user terminal;receiving coordinate information for a start point and an end point ofan additional-information signpost to be created newly on the 3D tourdisplayed on the user terminal; creating an additional-informationsignpost connecting the start point and the end point; and overlappinglydisplaying the created additional-information signpost on the 3D tour.2. The method for displaying additional information on a 3D tour ofclaim 1, wherein the receiving coordinate information for a start pointand an end point comprises: if a line connecting two points on the 3Dtour is inputted from the user terminal, setting one end of the inputtedline as the start point and setting the other end of the line as the endpoint.
 3. The method for displaying additional information on a 3D tourof claim 1, wherein the receiving coordinate information for a startpoint and an end point comprises: if only one point on the 3D tour isinputted from the user terminal, setting the inputted point as the endpoint, and setting a point on a floor surface or wall surface located atthe shortest distance from the inputted point as the start point.
 4. Themethod for displaying additional information on a 3D tour of claim 1,wherein the coordinate information for the start point and the end pointconsists of three-dimensional (3D) coordinates.
 5. The method fordisplaying additional information on a 3D tour of claim 1, wherein theadditional-information signpost is displayed in different shapes atdifferent locations in the 3D tour.
 6. The method for displayingadditional information on a 3D tour of claim 5, further comprising:providing an interface for selecting a photographing point on which theadditional-information signpost is displayed out of a plurality of imagephotographing points included in the 3D tour, wherein theadditional-information signpost is displayed only at a selectedphotographing point in the 3D tour.
 7. The method for displayingadditional information on a 3D tour of claim 1, wherein the 3D tourcomprises a floor plan of the particular space, and anadditional-information icon corresponding to the location of theadditional-information signpost is displayed on the floor plan.
 8. Themethod for displaying additional information on a 3D tour of claim 1,further comprising: providing the user terminal with an interface forsetting a color, a title, a description, or additional information ofthe additional-information signpost, wherein the additional-informationsignpost is created based on the color, title, description, oradditional information inputted via the interface.
 9. The method fordisplaying additional information on a 3D tour of claim 8, wherein theadditional information is displayed on one side of theadditional-information signpost, or displayed via a separate messagewindow if a user selects the additional-information signpost.
 10. Themethod for displaying additional information on a 3D tour of claim 8,wherein the additional information comprises one of a photo, a video,and a URL link.
 11. A method for displaying additional information on a3D tour performed by a 3D tour management server linked to a userterminal, the method comprising: simultaneously displaying a floor planfor a particular space and a 3D tour photographing interface on the userterminal; receiving a photographed image of the 3D tour for theparticular space from the user terminal; receiving additionalinformation via the user terminal in the process of photographing the 3Dtour; combining the 3D tour and the inputted additional information; anddisplaying the additional information on the 3D tour or the floor plan.12. The method for displaying additional information on a 3D tour ofclaim 11, wherein the combining the 3D tour and the inputted additionalinformation comprises: extracting location coordinates of the additionalinformation to be added onto the floor plan, based on a change in thephotographed image of the 3D tour; and mapping the inputted additionalinformation to the extracted location coordinates.
 13. The method fordisplaying additional information on a 3D tour of claim 12, wherein theextracting location coordinates of the additional information comprises:extracting a plurality of feature points from the photographed image ofthe 3D tour; and calculating a moving direction and a distance of thefeature points according to the change in the photographed image, andbased on this, extracting the location coordinates of the additionalinformation.
 14. The method for displaying additional information on a3D tour of claim 12, wherein the extracted location coordinates of theadditional information consist of two-dimensional (2D) coordinates, andthe mapping the inputted additional information to the extractedlocation coordinates comprises: converting the extracted locationcoordinates of the additional information into three-dimensional (3D)coordinates on the 3D tour; and mapping the additional information ontothe floor plan using the 2D coordinates, and mapping the additionalinformation onto the 3D tour using the 3D coordinates.
 15. The methodfor displaying additional information on a 3D tour of claim 11, whereinthe receiving additional information comprises: receiving a particularlocation for inserting the additional information on the floor planduring the 3D photographing; and receiving additional information to beinserted at the particular location via an interface for insertingadditional information.
 16. The method for displaying additionalinformation on a 3D tour of claim 15, wherein a photographing process ofthe 3D tour is displayed on one side of a screen of the user terminal,the floor plan is displayed on the other side of the screen of the userterminal, and the receiving a particular location comprises receivinglocation information selected by a user on the floor plan.
 17. Themethod for displaying additional information on a 3D tour of claim 15,wherein the interface for inserting additional information selects thetype of information of one of a note, a photo, a video, and an Internetlink, and receives additional information corresponding to that type ofinformation.
 18. The method for displaying additional information on a3D tour of claim 11, wherein the displaying the additional informationcomprises: displaying an additional-information icon at an insertionlocation of the additional information on the floor plan; and displayinga 3D additional-information signpost corresponding to theadditional-information icon on the 3D tour.
 19. The method fordisplaying additional information on a 3D tour of claim 18, wherein the3D additional-information signpost comprises: a start point located on afloor surface or wall surface of the 3D tour; an end point correspondingto the location of the additional-information icon; and a body partconnecting the starting point and the ending point.
 20. A system fordisplaying additional information on a 3D tour, the system comprising: aprocessor; and a memory having stored thereon a program executed by theprocessor, the program comprising: an operation of simultaneouslydisplaying a floor plan for a particular space and a 3D tourphotographing interface on a user terminal; an operation of receiving aphotographed image of the 3D tour for the particular space from the userterminal; an operation of receiving additional information via the userterminal in the process of photographing the 3D tour; an operation ofcombining the 3D tour and the inputted additional information; and anoperation of displaying the additional information on the 3D tour or thefloor plan.